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ABSTRACT 

A study concerning the development and validation of 
an instrument intended to measure Goal II of quality education is 
presented. This goal is that quality education should help every 
child acquire understanding and appreciation of persons belonging to 
social, cultural and ethnic groups different from his own. The 
rationale for measurement contains only a sample of possible 
definitions of this goal and the inventory measures only a sample of 
possible behaviors. Based on the findings from grade 5 and grade 11 
assessment data, a decision was made to use the nine items common to 
the inventories of both levels as the nucleus of an item pool for a 
grade 7 instrument. An item example is: How would you feel about 
sitting in class next to a person whose skin color is different from 
your own? Item construction was subject to the following restraints; 
the situation described in each item should be both possible and 
plausible and related to an individual stimulus rather than a class 
of stimuli. In order to score the sociometric instrument, the race, 

IQ level, socioeconomic level, religion and physical handicaps of 
each of the students in the two 7th grade classes were obtained from 
school records. It is concluded that this study present a model for 
future validity studies. The attitude measure produced can serve as a 
reasonably reliable and valid measure of 7th grade pupils* attitudes 
toward others who are different from themselves on the dimensions of 
race, religion, IQ, socioeconomic status, and physical 
characteristics. (CK) 
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Buck '.round 



T'.ie dennsyivania Department oi Education has developed and is imple- 
menting a pla.n to assess the quality of education in the public schools of 
the Commonwealth (Campbell and Beers, 1970). These tea goals, broadly stated 
and loosely defined, were the product of the cooperative efforts of the State 
Board of Education, Educational Testing Service and a committee of citizens 
representing leadership in many areas of the state. Although they are not 
ranked in any order of emphasis or importance, these ten goals of quality edu- 
cation represent goals whicn include more than the usual academics as repre- 
sented by the three R’s (Beers, 1970). 

Instrument packages to measure the ten goals of quality education have 
been prepared and validated for grades 5 and 11. The grade 7 package has been 
prepared and validation procedures are currently being completed. The develop- 
ment of a grade 3 package has just begun. Data were collected in the fall of 
1969 from 20,026 grade 5 pupils and 17,415 grade 11 pupils to develop norms 
for each of the goals (Hertzog, Beers and Campbell, 1970). In the fall of 
1971, data were collected from more than 2,700 pupils in grade 7. 

The study reported here concerns the development and validation of an 
instrument intended to measure Goal II; Quality education should help every 
child acquire understanding and appreciation of persons belonging tc oocial , 
cultural and ethnic groups different from his own . The rationale for measure- 
ment contains only a sample of possible definitions of this goal and the 
inventory measures only a sample of possible behaviors. It is left to school 
district personnel to further define the goals in light of their own program 
objectives . 
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If Coal II of quality education is to be rcali/jcd, .school;: must 
/ * 

i 

/ 

provide the experiences necessary for students to achieve an attitude of 

f 

/ 

\ acceptance of others who differ from themselves in racial, religious, 

intellectual, socioeconomic and physical characteristics. An attitude can 



either be the determinant or the consequent of an individual’s beliefs and 
behavioral intentions. The immediate antecedent of overt behavior is the 
behavioral intention of the individual (Fishbein, 1967). 

Instrument Development 

Based on the findings from the grade 5 and grade 11 assessment data, 
a decision was made to use the nine items common to the inventories of both 
levels as the nucleus of an item pool for a grade 7 instrument. Employing 
five point Likert response scale, the item format was in the form of a 
question. Examples of items used are as follows: 

I 

fl . How would you feel about sitting in class next to a person whose 
I skin color is different from your own? 

f 

I 2. How would you feel if your family moved into a neighborhood where 
most of the families were richer than yours? 

\ 

v 

Itemconstruction was subject to the following restraints: the situation 

described in each item should be both possible and plausible and related to 
an individual stimulus rather than a class of stimuli. Seventy additional 
items were generated to measure attitudes toward race, religion, intelligence, 
socioeconomic status and physical handicaps. These items were examined by a 
panel of 7th grade teachers who reviewed the instrument for readability, 
clarity and content validity. Upon the recommendations of the review panel, 

16 items were rejected. The remaining 54 items were reviewed and approved by 
the guidance personnel from a small city junior high school. 
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7i;e Coal II instrument was atE.un Lsterod to 7th oracle clause:-; in three 
.-.o :v school districts: a rural school with ail white students, three levels 

of Id and SES, and multiple religious backgrounds; a small city school with 
all white students, three levels of IQ and SES, and multiple religious back- 
grounds; and a small town school with all white students, three levels of IQ 
and SES, and multiple religious backgrounds. 

A Likert t was computed for each item using total data from all the 
clasps tested. Items were scored on a continuum from 1 to 5 for this analysis, 
All of the items discriminated between top-scoring 27 per cent and low-scoring 
27 per cent of the subjects. Additional analysis of the total data, utilizing 
a frequency count of responses to items, showed that some items failed to 
discriminate among r.rhools and among students within schools. These items 
and all of the items showing a Likert t of less than 4.417 were discarded. 

A split-half reliability coefficient was also computed on the total 
data, and an r =* .732 was found. 



Validation Procedures 

Based on rationale that behavioral intention is both an antecedent of 
overt behavior and either the determinant or consequent of attitude, a socio- 
metric instrument was constructed for use as a criterion for the validity of 
the Goal II instrument. 

Both the Goal I* instrument and the sociometric measure were adminis- 
tered to the two 7th grade classes on the same day at the same time. To control 
for the effect of the order of administration of the two measures, in one class 
the. Goal II instrument was administered first, in the other class the socio- 
metric measure was administered first. 
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A high correlation between responses on the Coal XI instrument items 
nnu actual choices on the sociomotric measurement for each of the pertinent 
factors (race, religion, intelligence, socioeconomic status and physical 
handicaps) was to be considered evidence of criterion-related validity for 
the items on the Goal II instrument. 



Scoring the Instruments and Analysis of Data 

In order to score the sociometric instrument, the race, IQ level, 
socioeconomic level, religion and physical handicaps of each of the students 
in the two 7th grade classes were obtained from school records. 

The hypergeometric distribution was used to compute, for 5-, 4-, 3- 
and 2-choice items, the probability that various combinations of choices 
could occur by chance. These probability figures were computed for all factors 
foy each 7th grade class. Any choice combination with a probability greater 
than .05 was accepted as evidence of the presence of bias relevant to the 
specific factor being considered. 

Both the sociometric and Goal II measurement of each factor were 
scored so that a total factor score of 0 indicated absence of bias and a 1 
indicated presence of bias. 

Table 1 shows the scoring procedures used for the sociometric instrument. 

% 

Table 2 shows the scoring procedures for the Goal II instrument. 

The absence of physical handicaps within the classes tested made it 
impossible to compute a sociometric score for this area. However, it was 
possible to compute a Pearson Product -Moment Correlation for the factors of 
race, religion, socioeconomic status and intelligence. These correlations 
and the levels of significance are shown in Table 3. 
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Scoring the Socionio Uric Measure 



Probability of Choice Combination 



Item Score 



1 

A- • 


p < .05 and choices of ’’others who 
are the same” predominate 


- 


2. 


p < .05 and choices of ’’others who 
are different” predominate 


+ 


3. 


p > .05 that a choice combination 
happens by chance selection 


+ 




Frequency of 4* Scores for Each Factor 


Factor Score 


, 


f t > 50% 0 


(absence of bias) 




f t < 50% 1 


(presence of bias) 




Table 2 






Scoring the Goal II Measure 






Item Response 


Item Score 


1. 


I cannot say 


0 


2. 


I would dislike it 


-2 


3. 


I would rather not 


-1 , 


A. 


I wouldn’t mind it 


+1 


5. 


I would like it 


+2 




Mean for Each Factor 


Factor Score 



X F > .50 
1...5 
X« < .50 
•1...5 



0 (absence of bias) 

1 (presence of bias) 



c 



Tab 1 c 3 



Factor Scores Correlated witu Socioactric Scores 



Factor 


r 


Level of Significan 


Race 


.4454 


.01 


IQ 


.7344 


.01 


SES 


.2851 


NS 


Religion 


.3563 


.05 



All of the factors with the exception of socioeconomic status showed 
significant correlation between the Goal II Instrument factor scores and 
sociometric factor scores. Socioeconomic status did approach the .05 level 
of significance (^95 * .288, rggg * .285). 

This validity study resulted from data collected during September, 
1971. A slightly refined version of the instrument was readministered to the 
same group of pupils in April of 1972. These administrations constitute, in 
essence, a test-retest situation with an intervening period of seven months. 
The Pearson Pro duct -Moment Correlation between the scores on the two adminis- 
t rat ions was .58 (p < .01} . 

Since the original validity study, additional information concerning 
the final form of the instrument has become available. In October, 1972, 
approximately 2,600 pupils from 90 schools in the Commonwealth were randomly 
selected and the final Goal II instrument was administered, and the school 
mean was selected as the unit of analysis. These data revealed the following 
technical characteristics: 

Number of Pupils 13 2,609 
Number of Items 33 50 

o 
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Moan 


ss 


166.059 


Variance (unbiased estimate) 


* 


48.665 


Standard Deviation (estimated) 




6.976 


Reliability (coefficient alpha) 


ss 


0.952 


Standard Error Measurement 


S3 


1.524 


Estimated Average Inter-Item 






Correlation 


33 


0.283 


Range 


S3 


33.990 



When the range of the 2,609 grade 7 pupils were correlated with scores 
received on the Crown-Marlowe Social Desirability Scale, a correlation coef- 
ficient of -0.072 indicated that the Goal IX instrument is not related to 
social desjjrability. 

/ This study presents a model for future validity studies. The attitude 

j 

j measure produced can serve as a reasonably reliable and valid measure of 
j 7th grade pupils' attitudes toward others who are different from themselves 
J on the dimensions of race, religion, IQ, socioeconomic status and physical 

/ 

/ characteristics . 
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